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ABSTRACT 

The information system for the Los Angeles City 
School District has been designed to provide relevant information in 
a readily available and concise manner. Equally important to the 
effectiveness of the information system, however, is that the 
decisionmaker have the capability to actually use the information. 
This report describes an in-service training program that will help 
insure that the decisionmaker has the necessary tools to process the 
information provided by the system in a productive manner. The course 
content of the program covers the basic concepts and tools needed in 
order to use the information generated. Special emphasis is given to 
an orientation to the information system in terms of its inputs and 
outputs. A format for conducting the in-service training program is 
suggested. This format includes the time period of instruction, the 
method, the materials and the nature of the participants and the 
staff. (Other reports in this series are: LI003908 through 003911). 
(Author) 
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PREFACE 



In response to community, legislative, and student pressures, school 
administrators have recently begun to examine the potential of modern 
management tools and practices. This search for techniques that might 
function effectively in an educational context led to the adaptation of 
such methods as program budgeting and accountability. Another tool fre- 
quently chosen for educational assistance is the modern management in- 
formation system, a computer-based aid to planning and decisionmaking. 

In late 1970, the Los Angeles Unified School District (LAUSD) con- 
tracted with The Rand Corporation to design such an information system 
in support of educational management. The system is specifically in- 
tended to aid planning and decisionmaking (through implementation of 
accountability and program budgeting) in schools partially supported by 
Title I provisions of the Elementary and Secondary Education Act. 

This report describes a program for in-service trajning of the 
users of the information system. The in-service training program is 
designed to insure that the decisionmaker is aware of the information 
he must have to make his decisions in an effective manner. This report 
is the sixth (and final) report in the series describing the work car- 
ried out. The other volumes in the series are the following: 

o J. A. Farquhar and B. W. Boehm, An Information System for Ed- 
ucational Management , Vol. 1: Design Considerations , R-9 30-LACS. 

Defines near-term information system requirements, design guide- 
lines, major design constraints, and information needs of ed- 
ucational decisionmakers. 

o M. L. Rapp, An Information System for Educational Management , 

Vol. 11: Data Requirements for Accountability , R-931-LACS. 

Defines the future shape of the accountability system and fea- 
sible long-term trends and requirements in the areas of re- 
search and evaluation. 

o T. S. Donaldson, An Information System for Educational Manage- 
ment, Vol. ill: Data Requirements for Evaluation: A Review 

of Educational Research , R— 932— LACS. Reviews and discusses 





the literature concerning student evaluation, providing direc- 
tion for eventual information system growth. 

J. A. Farquhar, D. H. Stewart, J. Lombaerde, An Information 
System for Educational Management , Vol. IV: Functional De- 

sign , R-933-LACS. A functional description of the proposed 
information system, specifying input and output data, file 
formats, and necessary processing. 

J. A. Farquhar, I. M. Iwashita, S. H. Landa, An Information 
System for Educational Management , Vol. V: A Design for Im- 

plementation , R-934-LACS. Describes and discusses alternative 
hardware, software, and support configurations that might pro- 
vide the desired services, and the costs and benefits of each. 
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SUMMARY 



The information system for the Los Angeles City School District 
has been designed to provide relevant information in a readily avail- 
able and concise manner. Equally important to the effectiveness of 
the information system, however, is that the decisionmaker have the 
capability to actually use the information. This report describes an 
in-service training program that will help insure that the decision- 
maker has the necessary tools to process the information provided by 
the system in a productive manner. 

The course content of the program covers the basic concepts and 
tools needed in order to use the information generated. Special em- 
phasis is given to an orientation to the information system in terms 
of its inputs and outputs. A format for conducting the in-service 
training program is suggested. This format includes the time period 
of instruction, the method, the materials and the nature of the partici- 
pants and the staff. 
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I . INTRODUCTION 



ERIC 



This report describes an in-service training program for implemen- 
tation of the prototype information system designed by The Rand Corpo- 
ration for the Los Angeles Unified School District (LAUSD) . The infor- 
mation system is for use at the individual school and classroom level, 
and this is reflected in the in-service training program. The impact 
of decisions made at the school level on decisionmaking at other levels 
was a primary consideration in the design of the training program be- 
cause the prototype information system was intentionally designed to 
be extended to other operational levels within the LAUSD. 

In developing the in-service training program, the concern was with 
the analytical aspect of decisionmaking — the kinds of analysis that 
would be done by staff members, the problems they would encounter, the 
tools they would need, and especially the data they would use. 

Preliminary considerations in the design of the training program 
are presented in Sec. II. General guidelines for the substance and for- 
mat of the training program are developed from a study of the decisions 
that are implied in the information system. General classes of deci- 
sions are defined and the necessary skills to use the information sys- 
tem to illuminate those decisions are delineated. Constraints, such as 
time and cost, that will affect the training program are also considered. 

Section III outlines the training program. The program consists 
of four parts — basic concepts, basic tools, use of the information sys- 
tem, and integrating workshops. For each part, a list of readings is 
provided along with a description of the content and purposes of each 
reading in the context of the training program. In cases where material 
is not presently available, proposed syllabus material is presented in 
outline form. The integrating workshops will be run on the case method, 
but they have not yet been completely specified. This is intentional; 
to be effective, the training program needs to develop case material 
that is relevant and timely to the type of decisions being faced in the 
LAUSD. It is planned t t he preparation of case material will take 
place concurrently with the implementation of the information system. 
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II. THE DESIGN OF THE IN-SERVICE TRAINING PROGRAM 
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RATIONALE 

The school principal is a logical focal point in the flow of in- 
formation within the LAUSD and in the implementation of the information 
system. Being close to the classroom interaction of teachers and stu- 
dents, the principal is in a position to provide an active link between 
the classroom level and either the area or district level of decisionmaking. 
The in-service training program capitalizes on this linkage by design- 
ing the content of the program primarily to support the school princi- 
pal; the content is, however, sufficiently broad to cover the needs of 
other levels of decisionmaking. Additional, more highly-focused ma- 
terial can be incorporated in the training program to serve the needs 
of other staff members as they become more actively involved. 

i 

' The principal should he provided with the basic concepts and tools 
of analysis so that he can make more meaningful decisions about pro- 
grams, staffing, student achievement, and resource use within the school. 

In addition, the data should be transformed into information relevant 
to the decisionmaking needs of other educational levels, such as area, 
district, and state. The in-service training program is designed to 
develop this analytical capability and, thus, insure the effective use 
of the information system. 

The training program has two general characteristics — substance 
and format. For an efficient program, both the substance and format 
of the training program should flow from the requirements of the deci- 
sionmaker for technical skills, and the constraints imposed on the 
training program by the operating environment in which the LAUSD finds 
itself. The general considerations that shaped the substance and for- 
mat of the proposed in-service training program are reviewed here. 

SUBSTANCE 

The substance of the training program is derived from the required 
technical skills needed for decisionmaking and the inventory of skills 
likely to be possessed by the personnel to be trained. Since there is 
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no readily available inventory of the present administrators’ technical 
skills, some judgments were made based on discussions with LAUSD 
personnel and from other experience in the training of school personnel. 

Table 1 presents a matrix of the type of decisions or functions 
that the information system will service and the technical knowledge 
that should be applied in the decision process. Each x in the matrix 
designates the types of tools that the decisionmaker must have to fully 
utilize the information system for each type of decision. 

No attempt has been made to identify the decisionmaker in each case. 
Many staff personnel will have had a part in shaping the information for 
the decisionmaker. It is especially important that those who implement 
the decision should understand the basis for the decision. For these 
reasons, in-serv: ca t. aining should be appropriate for all those in- 
volved in the decisionmaking process and should not be limited to the 
decisionmakers only. 

A discussion of how this matrix of decisions or functions was de- 
veloped is helpful to understanding the matrix itself. This can be il- 
lustrated by a delineation of the skills necessary for program selec- 
tion in the planning function. The decisionmaker needs to determine 
the resource implications and benefits of alternative educational pro- 
grams. Some of the things that he must consider are the following: 

1. What is the basic framework for program selection (basic 
concept — systems analysis)? 

2. Toward what objective is the program directed (basic concept — 
program budgeting)? 

3. How are costs and benefits to be estimated (basic tools — 
statistical analysis, resource and effectiveness analysis)? 

4. How can the problems be put in systematic form so that the 
implications of various assumptions can be revealed (basic 
tool — modeling) ? 

5. Which costs are relevant to this decision (basic tool — 
resource analysis)? 

6. How are benefits to be measured (basic tool — effectiveness 
analysis) ? 
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The purpose of the training is not to make the decisionmaker an ex- 
pert in the use of the various tools and concepts that are introduced; 
rather it is to expose the decisionmaker to what is available, under 
what situations it can be used, and most importantly, what its limitations 
are. If, for example, most program analysis is performed by a central 
group at the district level, the principal should know what this group 
can do for him and be able to interpret the results from such analysis. 
Moreover, he should be able to apply the analytical thinking that is in- 
herent in much of the training material to decisions that he must make on 
a daily basis. Analysis comes in many forms; often, the least complex 
is the most useful in handling the many management problems of a school. 

FORMAT 

The format of this training program is dictated by the many con- 
straints that are imposed on the LAUSD. A full year, in-residence 
course in systems analysis for school principals, for example, may make 
a large contribution to the better management of the school system. It 
is surely not the best alternative available, however, when the cost 
(staff time and dollars) of the program is considered. Costs aside, it 
is not feasible because there is no way to free the principals for such 
an extended period of off-site training. 

These constraints have an impact on (1) length of time of instruc- 
tion, (2) method of instruction, (3) instructional material, (4) train- 
ing session participants, and (5) instructional staff. 

Time of Instruction 

Since principals or other district staff cannot be gone for long 
periods of time during the school year, the training program is designed 
either for intensive instruction in a single period or a series of short 
sessions during the school year. 

Method of Instruction 

The emphasis of the training session is on the case method of in- 
struction. In this method, the participants combine their own basic 
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knowledge of decisionmaking with knowledge gained through simulated de- 
cision exercises. As a result, the case method allows the participants 
to gain from each other’s thoughts and experiences. This interaction 
will be especially important in illustrating the possibilities and limi- 
tations in the implementation and use of the information system. 

The more technical subjects will be taught by the lecture method. 

Even in those areas, however, the emphasis will be on examples of the 
technical tools in use. The objective will be to increase understand- 
ing of the tool and not necessarily the use of the tool. 

Training Material 

Since the method of instruction will mainly be case discussion, 
most of the background material will have to be learned out of class. 

A package of material should be developed that can be read by the par- 
ticipants in order to prepare them for the case sessions. The case 
sessions can then concentrate on demonstrating the use and limitations 
of the material in practice. 

Training Session Participants 

The training session should include a cross-section of the person- 
nel that will be involved in operating and using the information system. 
This will allow the various participants to see the total picture of 
how the information is generated and who uses the various types of in- 
formation for what purposes. The particular class mix is left to the 
LAUSD after considering the cost and time available of prospective par- 
ticipants. 

Instructional Staff 

Whether the LAUSD needs to hire a consultant to conduct part of 
the training is a question of the availability of district personnel 
and money. Since much of the material will be case material, however, 
it is clear that any consultant must work closely with the LAUSD in 
its development. The LAUSD must be willing to devote some personnel 
time to the development of the training course if a consultant conducts 
the sessions. 

13 
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III. THE IN-SERVICE TRAINING PROGRAM 

The course content of the training program is divided into the fol- 
lowing categories: 

1. Basic concepts. 

2. Basic tools. 

3. Information system orientation. 

4. Integrating workshops. 

A syllabus is suggested for each part of each category. In addition, 
some of the reading materials to be used in each part of the course are 
shown in Table 2. 

BASIC CONCEPTS 

This part of the training program introduces the participant to 
the planning and administrative concepts that were used in the design 
of the information system. The purpose is not only to present new types 
of planning techniques, but to contrast the new with the old in order 
to give the participant an appreciation of how any differences in the 
planning methodology will help him perform his job more effectively. 
Three basic concepts will be covered: systems analysis, planning- 

programming-budgeting, and accountability. The material to be presented 
for each concept is discussed below. 

Systems Analysis 

While much has been published concerning the systems approach in 
education, much of it is not suited for the training program. Some 
material is too lengthy for the limited purpose of introducing the sub- 
ject of systems analysis. Other material is too one-sided in its praise 
of systems analysis to be of use to the educational manager who must be 
aware of all the limitations involved. Thus, material must be specially 
prepared for the training program. 



* 

See the Bibliography for complete references. 
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SELECTED READING MATERIALS FOR IN-SERVICE TRAINING PROGRAM IN SUPPORT OF THE INFORMATION SYSTEM 
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Sys terns Analysis Syllabus 

I. The Systems Approach. 

A. Definition. The systems approach and how it differs from 
traditional planning methods. 

B. Benefits and Costs of the Systems Approach. 

C. Limitations of the Systems Approach for Educational Man- 
agement . 

1. Problems in measurement. 

2. Distribution of costs and benefits. 

II. Critical Analysis of the Systems Approach in Use. 

An example of the systems approach in education will be exam- 
ined for its impact on the decision process. How was the de- 
cision changed because of systems analysis? What were the 
weaknesses in the analysis? How much reliance can be put on 
quantitative studies? 

III. Case Study. 

Planning-Programming-Budgeting System 

The nature of the planning-programming-budgeting system (PPBS) is 
explored in this part of the training program. The emphasis is on the 
data required for the system, the information generated by the system, 
and the program analysis aspects of an operational PPBS. In particular, 
the differences between the traditional budgeting methods and the bud- 
geting component of PPBS are delineated. 

Planning-Programming-Budgeting System Syllabus 
I. The Nature of PPBS. 

A. The components of PPBS. 

B. The use of PPBS. 

C. Comparison with traditional planning and budgeting methods. 

D. Data requirements. 
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II. Program Structure. 

A. Theoretical considerations in developing the structure. 

B. Examples of program structures. 

C. Merits of alternative structures. 

III. Program Analysis. 

A. Analysis of resources and cost. 

B. Analysis of effectiveness. 

C. Cost-effectiveness . 

Accountability 

The basic arguments for accountability, a description of how ac- 
countability can be made operational, and the details of the relation- 
ship of the information system accountability provide the basic content 
of this section of the course. 

Accountability Syllabus 

I. Concept of Accountability. 

A. Characteristics of accountability. 

B. Purpose. 

II. Development of Accountability. 

A. Data requirements. 

B. The structural aspect of accountability. 

C. Development of measures. 

III. Relationship of Accountability to the Information System. 

BASIC TOOLS 

Basic concepts are concerned with what should be done in the plan- 
ning process. In order to implement the basic concepts, however, the 
decisionmaker will need, in many cases, additional tools. The more 
important of these tools are discussed in this part of the training 
program. 
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Resource Analysis 

In estimating the cost of various programs, it is important to know 
which types of cost are relevant to the decision toward which the anal- 
ysis is directed. The syllabus material illustrates the cost concepts 
in educational planning. With the use of an example, the syllabus ma- 
terial integrates the concepts of PPBS with the modeling and statisti- 
cal analysis tools necessary for educational planning. 

Resource Analysis Syllabus 

I. Definition of a Program. 

II. Development of Analytical Framework. 

III. Estimation of Resource Requirements. 

IV. Estimation of Program Cost. 

V. Sensitivity Analysis. 

VI. Case Study. 



Statistical Analysis 

The published material on statistical techniques has either of two 
faults. First, most of the material is too technical to meet the needs 
of most administrators. Second, the material is usually not directed 
toward examining the usefulness of statistical analysis in education. 
Therefore, the development of the course material is both written at 
the appropriate technical level and designed for use by education man- 
agers. 

Statistical Analysis Syllabus 

I. Descriptive Statistics. 

II. Hypothesis Testing. 

III. Regression Analysis. 

A. The type of problem where regression analysis is most 
useful. 

B. The scatter diagram. 

C. Choosing the functional form. 
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D. Fitting the curve. 

E. Prediction — measures of confidence. 

F. Sensitivity analysis. 

IV. Case Study. 

Evaluation/Research 

It is suggested that parts of the Campbell and Stanley book be 
used in the training program because of its exposition of the validity 
of various research designs. The intent is not to explore the processes 
and techniques of educational research in depth; rather it is to develop 
an understanding of the assumptions that must be made if the research re- 
sults are to be accepted in the decision process. The problems encoun- 
tered with a variety of research designs are well documented in this book. 

Syllabus material consists of cases to which the participant can 
apply what was learned from the reading. The results of various re- 
search designs will be given, and the participant will then interpret 
the results. 

Effectiveness Analysis 

The participant is given an overview of effectiveness analysis in 
eduaation. The emphasis is on methods and techniques required for the 
analysis of educational outcome. The participant is provided with data 
and is required to interpret the results. 

Effectiveness Analysis Syllabus 

I. Data Requirements. 

A. Types of data needed. 

B. Sources. 

II. Measures of Effectiveness. 

A. Achievement measures. 

B. Other measures. 

£ 

Donald T. Campbell and Julian C. Stanley, Experimental and Quasi- 
Experimental Designs for Research , Rand McNally, Chicago, Illinois, 1966. 
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III. Analysis of Effectiveness. 

A. Structuring the analysis. 

B. Conducting the analysis. 

C. Interpreting the results. 

IV. Case Study. 



Modeling 

A general introduction to the design and purpose of models in ed- 
ucation is provided. Examples of how models of school district opera- 
tions can be formulated and used are described. The syllabus material 
covers the development of such models, the use of such models, and the 
limitations of these models in educational planning. 

Modeling Syllabus 

I. Benefits and Limitations of Models. 

II . Model Development . 

A. Identifying the outputs of the model. 

B. Identifying the inputs of the model. 

1. Data problems. 

2. Selecting policy variables. 

C. Relating Inputs to Outputs. 

III. Examples of Models in Use. 

IV. Case Study. 

INFORMATION SYSTEM ORIENTATION 

This part of ti e in-service training program will provide the par- 
ticipants with a vjrking knowledge of the information system. The in- 
formational content of all reports generated as outputs of the system 
will be described. The participants are required to identify the data 
sources for information and the appropriate analytical concepts and 
skills necessary to support decisions in their area of responsibility. 
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This part of the training program is designed to give the participants 
an appreciation of the impacts of the information on decisions made in 
other functional areas and at other decisionmaking levels. 

Information System Orientation Syllabus 

I. The Information System. 

A. Data requirements (inputs). 

B. Reports (outputs). 

II. Information Content of Reports. 

A. Personnel. 

B. Program/budget. 

C. Classroom/evaluation. 

D. Community status. 

III. User Interface with Information System. 

A. Teacher. 

B. Principal. 

C. Administrative levels (within district). 

D. Educational system (extra-district). 

INTEGRATING WORKSHOPS 

During the implementation phase of the project, exercises related 
to the problems involved in using the information system will be car- 
ried out. These exercises are to be used by the participants to further 
their understanding of how the information system enters into the deci- 
sion process. An important function of the integrating workshops is 
to assess how well the information system supports the decisionmaking 
process and to determine how the information system might be changed to 
better meet the needs of its users. 
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